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1. INTRODUCTION 

Currently, multimedia presentations have been widely used in various fields [1]—[5]. A multimedia 
authoring tool is useful to make it easier for an author to create a multimedia presentation. A multimedia 
authoring tool helps an author produce multimedia documents from various media objects inserted by an 
author [6]. The media objects consist of two kinds: visual media objects and non-visual media objects [7]. 
Visual media objects such as text, images, animations, videos, and others [8], [9]. Non-visual media objects 
such as songs, music, sounds, and others [10]. The author uses the functions contained in the multimedia 
authoring tool to assist in the creation of multimedia documents correctly. The functions contained in the 
multimedia authoring tool are inserting various media objects, preparing root layouts, preparing regions for 
visual media sites, cutting copy and pasting on media objects, verifying time computations, verifying spatial- 
temporal, and others [11]. Two essential parameters in multimedia authoring are timing/temporal, as shown 
in Figure 1(a), and the position/spatial of each media object, as shown in Figure 1(b). Each media object must 
have three properties: start time, end time, and duration in a media presentation [12]. These three properties 
are attached to each media object regardless the media object will be played once or more [13]. A multimedia 
presentation must have a root layout with a specific width and height. 

The root layout is usually divided into several regions of different sizes. A region can have a starting 
location (top and left) that can be the same or different from other regions. After the visual media objects in 
the temporal layout are inserted in a certain region, it will become a multimedia presentation [14]. After the 
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process is complete, it will be seen that there is a possibility of an error which is called a spatial-temporal 
conflict [15]. The conflict can be verified using Spatio-temporal verification and time computation but rarely 
fixes the error. 
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Figure 1. Two essential multimedia layouts (a) timeline/temporal layout and (b) location/spatial layout 


Multimedia authoring tool is an application that began to be developed at the beginning of the 21“ 
century [16]. The study of multimedia authoring tools begins with research on the basic features for 
managing media objects into a multimedia document [17]. A multimedia authoring tool has three basic 
processes to produce a multimedia document. The three processes are called the Kernel mechanism: editing, 
modeling, and verification. 

The editing process is the initial process in making multimedia presentations that are very dependent 
on the user interface on multimedia authoring tools. The editing process is the initial process in making 
multimedia presentations that are very dependent on the user interface on multimedia authoring tools [18]. 
Ease in the editing process is the first thing that an author pays attention to, various ways have been 
attempted and researched to increase the ease of making multimedia presentations [19]. One of them is the 
use of what you see is what you get (WYSIWYG), a must in a multimedia authoring tool [20]. The system in 
making multimedia presentations is important in facilitating interaction with the author, such as using a 
collaborative system in a multimedia presentation. A correct and more advanced control needs to be 
implemented in a multimedia authoring tool [21]. 

Expressivity is the ease of inserting media objects and processing the media objects. Reusing a 
media object for use in a multimedia presentation is also a feature of expressivity [22]. The important thing in 
the multimedia authoring tool is the existence of temporal formatting. The presence of spatial layout and 
temporal layout in the user interface is a must. Temporal formatting can be used as a pre-verification for the 
initial checking of spatial-temporal conflicts. The verification can use a system called time computation, 
which is applied to the temporal layout of a multimedia authoring tool [23]. The formatting process on the 
temporal layout is a continuous consistent check that works in the background when the author is still editing 
the editing process [24]. 

Verification results must be informed to the author using the user interface contained in the 
multimedia authoring tool. The information provided must be complete enough, such as the type of error, 
location, and others. Information to users can be placed in the message zone [2]. The information provided is 
as detailed as possible, the information is given in several tabs. This can make it easier for an author to 
improve multimedia presentations [25]. The spatial representation referred to in the study entitled 
“Adaptation Spatio-temporal et hypermedia de documents multimedia” has eight conditions, as shown in 
Figure 2. Fatma et al. [25], the spatial layout was verified using the Spatio-temporal inconsistencies 
verification algorithm (SIVA). Spatio-temporal can be used to check conflicts between regions [26]. 
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Figure 2. Spatial representation by sébastien laborie 
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Temp verification = ((startn > start m) A (start n (1) 
< (start m+ dur m))) V ((start m = start n) A (start m 
< (start n + dur n))) 


Spatial verification = (left m < (left n + height n))A ((top n — width n) (2) 
< (top m — width m)) A ((top m — width m) < top n) 


According to Santos et al. [27], conducted Spatio-temporal validation research on multimedia 
documents to find and correct errors before multimedia document deployment. The study groups the possible 
Spatio-temporal conflict into three cases. The first case is if media object n is presented before media object 
m, as shown in Figure 3(a). 

In the second case, it occurs if the media object n has a fixed position and the media object m has a 
moving position, as shown in Figure 3(b). The spatial-temporal layout validation must check whether there is 
overlap at a certain time. Case 3 is a more complex case than case 2, as shown in Figure 3(c). In the third 
case, there are two shifts in the media object; at tl there is a shift in the object media n and at t2 there is a 
shift in the object media m. In this study, the size and location of overlapping media objects were changed at 
certain time conditions. This system checks every region that is active at a certain time. These regions will be 
validated whether there is overlapping, if there is overlapping, scaling and position shifting will be carried 
out to avoid overlapping, as shown in Figure 4. 
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Figure 3. Spatio-temporal validation cases (a) case 1, (b) case 2, and (c) case 3 
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Figure 4. Spatio-temporal conflict corrections 


Bouyakoub and Belkhir [28], in 2012 conducted a study to find a solution to the Spatio-temporal 
problem of conflict in SMIL builder V2. In this study, the spatial conflicts consisted of 81 types of spatial 
conflicts that could occur. Experiments were carried out in this study by providing overlapping regions. 
Region 1 and region 2 are overlapping areas, while region 3 does not overlap at all. First, the system verifies 
overlapping regions, in the experiment it will detect region 1 and region 2 overlapping. Second, the system 
determines that region 2 is the problem and overrides other regions. Third, the system will assign an area for 
region 1 and region 3 to calculate the empty area needed for region 2. Fourth, if there is an empty area for an 
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overlapping region, then region 2 will be assigned to one part of the area that is still vacant, as shown in 


Figure 5. 
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Figure 5. Overlapping corrections 


2. METHOD 

The process proposed in this study is divided into several stages: overlapping detection, Spatio- 
temporal verification, and auto-correction, as shown in Figure 6. The first process in spatial auto-correction is 
initiated by detecting overlapping regions. Algorithm 1 is an algorithm to detect overlapping regions. 


Multimedia document (source) 
Overlapping detection 


Spatio-temporal verification 


Auto-correction 


Multimedia document (corrected) 


Figure 6. Auto-correction method 


Algorithm 1 Multiple Overlapping Detection 

n «+ number of regions 

ke 0 

for(i=1; i<n ; i++) 

For (j=1; j<n; j++) 

if (( (region (j,left) > region(i,left) ) && (region (j,left) < 
region (i,left)+region(i,width) ) ) | ( (region (j, left) + region(j,width) > 
region(i,left) ) && (region (j, left) +region(j,width) < region(i,left) 
+region(i,width) ) ) 
&& 
(region (j, top) > region(i,top) ) && region (j, top) < 
region (i,top)+region (i,height))) [I ( (region (j, top)+ region (j,height) > 
region (i,top)) && (region (j,top) +region(j,height) < region (i, top) 
+region (i,height)))) 

6: k++ 

overlap (k,1) e i 

8: overlap(k,2) = j 

end if 
end for 
end for 


Ot wWNnNE 


i 


The algorithm can detect all overlaps that may occur in each region in a root layout. The overlapping 
formula in the algorithm uses a formula to detect a collision between two objects. When several regions 
overlap, it does not mean that the region needs to be relocated. The combination of temporal and spatial 
information is called Spatio-temporal, determining the actual conflict between regions [26]. The next process 
is to perform Spatio-temporal verification, which serves to find out whether overlapping regions display 
media objects at the same time. If it turns out that there are no media objects that are displayed 
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simultaneously in the overlapping region, then the region does not need to be relocated. However, if media 
objects are displayed simultaneously in overlapping regions, one of those regions needs to be relocated. 
Algorithm 2 is an algorithm to verify conflict two media objects in different regions. 


Algorithm 2: Spatio-temporal verification 
Is 
2: 
33 


CONANA 


AwWwWwNnNEBeOoO 


m - number of media objects 
for(i=1; ism; i++) 
media_ object (i, end, region) a media object (i, begin, region) + 
media_ object (i, duration, region) 
end for 
for (i=1l;is<m; i++) 
for (j=i;j<m-1; j++) 
if(media_object(i,begin, region) > (media_object(j,begin, region) 
t - media object (i, begin, region) 
media_object(i,begin,region) =- media object (j,begin, region) 
media_object(j,begin, region) =- t 
end if 
end for 
end for 
os 0 
for(i=1; iSn; i++) 
x - overlap (k,1) 
y « overlap (k,2) 


if ((media_objek(i,end,x) > media_objek(i,begin,y) && media objek(i,end,x) < 
media_objek(i,end,y)) || (media_objek(i,end,y) > media _objek(i,begin,x) && 
media_objek(i,end,y) < media_objek(i,end,x) )) 

c++ 


conflict(c,1) = x 
conflict(c,2) = y 
end if 
end for 


Every occurrence of a spatial conflict that has been detected needs to be categorized into several 


possibilities. Spatial conflicts are divided into several categories as follows. The first category is the 
horizontal conflict between several regions, as shown in Figure 7(a). The second category is the occurrence 
of vertical conflicts, as shown in Figure 7(b). The process for correcting conflicts by relocating regions can 
be processed using Algorithm 3. 
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Figure 7. Two types of spatial conflicts (a) horizontal conflicts and (b) vertical conflicts 


Algorithm 3: Auto-correction 


1 
2 
Be 
4 
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c «— number of conflicts 
For(a=1; iSn; i++) 

i «— conflict(a,1) 

j + conflict (a,2) 


if (( (region (j, left) > region (i,left) ) && (region (j,left) < 
region (i, left) +region(i,width) ) ) 1 | ( (region (j, left) + region (j,width) > 
region (i,left) ) && (region (j, left) +region(j,width) < region (i, left) 
+region(i,width))) = true 

&& 

(region (j, top) > region(i,top) ) && region (j, top) < 
region (i,top)+region (i,height))) [I ( (region (j,top)+ region (j,height) > 
region(i,top) ) && (region (j,top) +region(j,height) < region (i, top) 
+region(i,height))) = false 


if((region(i,left) < (region (j,left)) 
region(i,left) - 0 
region(j,left) « root (width) -region (j,width) 
else 
region(j,left) « 0 
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10: region(i,left) - root (width) -region(i,width) 
end if 
end if 
lilies if (( (region (j,left) > region(i,left) ) &E& (region (j, left) < 
region (i,left)+region(i,width) ) ) 1 | ( (region (j, left) + region (j,width) > 
region(i,left) ) && (region (j, left) +region(j,width) < region (i, left) 
+region (i,width))) = false 
&& 
(region (j, top) > region (i,top) ) && region (j, top) < 
region (i,top)+region(i,height) ) ) ll ( (region (j,top)+ region (j,height) > 
region (i,top)) && (region (j, top) +region (j, height) < region (i, top) 
+region(i,height))) = true 
12: if((region(i,top) < (region(i,top) ) 
13% region(i,top) « 0 
14: region(j,top) « root (height) -region(j,height) 
else 
15: region(j,height) < 0 
16: region(i,height) - root (height) -region(i,height) 
end if 
end if 
end for 


3. RESULTS AND DISCUSSION 

Experiments in this study were carried out with several kinds of data sets. In the first data set, two 
regions overlap horizontally, as shown in Figure 8(a). The two images overlap; after the auto-correction 
process is carried out, the correction results are obtained by relocating the two images so they no longer 
overlap. Figure 8(b) shows auto-correction on two vertically overlapping images. 
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Figure 8. Two types of correction (a) horizontal overlap corrections and (b) vertical overlap corrections 


Figure 9(a) shows the auto-correction of three overlapping images. The correction algorithm will 
perform two correction stages: first is to process a horizontal correction and then a vertical correction. 
Figure 9(b) shows four overlapping images in a multimedia presentation. The auto-correction process is also 
carried out in two stages, the first stage is to make horizontal corrections. At this stage, the two pairs of 
images are separated horizontally but still overlap vertically. In the second stage, the relocation is processed 
vertically, so that the whole image does not overlap anymore. 
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Figure 9. Multiple spatial overlap corrections (a) three regions and (b) four regions 


This study has succeeded in providing novelty in the auto-correction of spatial conflicts by 
correcting four conflicting regions in multimedia authoring. In previous studies, it has been able to correct 
when there is a spatial-temporal conflict, but only in two or three regions. Table 1 compares the success of 
correcting the spatial conflicts in this study with existing studies. 


Table 1. Comparison with previous studies 
Studies Conflicting areas 
Two regions Threeregions Four regions 


The proposed study 
[27] 
[25] 
[28] 


ace =) 
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4. CONCLUSION 

In a multimedia presentation, often, an author makes an error in creating a region area that causes 
the overlapping of several media objects. A novel method in this study is to auto-correct multiple spatial 
conflicts using several stages of the process: overlapping detection, Spatio-temporal verification, and auto- 
correction. This study conducted several experiments with two spatial overlaps, three spatial overlaps, and 
four spatial overlaps. The algorithm proposed in this study automatically corrected up to four spatial 
conflicts. Correcting multiple spatial conflicts can be successful using two relocation stages: horizontal 
relocation and vertical relocation. This study has limitations in solving cases if too many pairs of overlapping 
media objects cause the inability to be completed perfectly. Improvements that could be investigated in the 
future include separating the spatial-temporal overlapping into different time domains. 
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